10/591828 
IAP12 Rec'd PCT/PTO 3 6 SEP 2006 

WO 2005/093711 * PCT7IB2004/001053 

1 

TITLE 

Autonomous musical output using a mutually inhibited neuronal network. 

FIELD OF THE INVENTION 
5 Embodiments of the invention relate to generating autonomous musical output 
using a mutually inhibited neuronal network. 

BACKGROUND TO THE INVENTION 

10 "A Method of Generating Musical Motion Patterns", a Doctoral Dissertation, 
Hakapaino, Helsinki, 2000 by Pauli Laine describes in detail the autonomous 
creation of music using a central pattern generator and, in particular, a mutually 
inhibited neuronal network (MINN). This methodology described in the 
dissertation was unable to reliably produce good musical patterns and it easily 

15 generated chaotic patterns that were without noticeable periodicity. It was also 
difficult it to generate patterns with longer period-lengths (like 16-32 or 64) or with 
sub-periods (for example a larger period 64 and inside that patterns of 8). 

It would be desirable to provide an improved mechanism and method for 
20 autonomously producing music. 

BRIEF DESCRIPTION OF THE INVENTION 

Embodiments of the invention are able to generate very long and 'musical 1 output 
25 that does not easily become non-periodic and has sub-periods. 

BRIEF DESCRIPTION OF THE DRAWINGS 



30 



For a better understanding of the present invention reference will now be made 
by way of example only to the accompanying drawings in which: 
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Fig 1 illustrates a network object; and 
Fig 2 illustrates a graphical user interface. 

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION 

5 

An artificial neuronal network (ANN) is a set of connected computational nodes. 
In embodiments of the invention, the network is not a learning network in which 
changes in connection weights are inspected but is a small network of between 
5 and 50 nodes (typically) in which the dynamic firing behavior of the network is 
10 inspected in detail at regular intervals. 

Each node can be connected to receive a neuronal impulse or impulses, output 
from one or more other nodes, and each node can be connected to provide as 
output a neuronal impulse to one or more other nodes. 

15 

A neuronal impulse received at a node can have an activation or an inhibitory 
effect depending upon whether the connection on which the neuronal impulse is 
received is an activation connection or an inhibitory connection. An activation 
effect increases the activation level of the node according to a simple activation 
20 function, such as a sigmoid function. An inhibiting effect inhibits or prevents an 
increase in the activation level of the node. When the node's activation level 
reaches a threshold value, the node fires and produces a neuronal impulse as 
output. After firing the activity level of the node quickly goes to zero or a low non- 
zero value depending upon implementation. 

25 

An input impulse received at a node may be a neuronal impulse output from a 
connected node or may be one of a plurality of excitory impulses provided 
across the network according to a predetermined pattern. These excitory 
impulses have an activation effect. They increase the activity of the network and 
30 may be provided to all or some of the nodes of the network at each interval. 
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An additional feature of the described neuronal network model is the vanishing 
(excitation) parameter. If the vanishing (excitation) parameter is zero or not 
implemented, then if there is no excitory or neuronal activation input the 
activation level of the node would remain constant. However, in the preferred 
5 implementation, the current activation level is multiplied by the vanishing 

(excitation) parameter value, which is may be grater or less than 1 and is typically 
a value between 0.5 to 1 .2. If the vanishing parameter is greater than 1 , then 
after a certain time, and even without any input, the activation level reaches the 
threshold and the node fires, after that the activation level decreases to or near to 
10 zero depending upon implementation. This feature introduces self-oscillation, 
which enhances the periodicity of the network output. If the vanishing parameter 
is below 1 there is no self-oscillation. 

The presence of multiple inhibitory and activation connections in the neuronal 
15 network creates a neuronal central pattern generator (CPG), which makes a 
dynamic oscillating pattern in two dimensions that has cycles within cycles. The 
dimensions include time and space i.e. the timing at which nodes fire and the 
identity of the nodes that fire. The dynamic pattern of what nodes fire when, 
produced by the CPG, is translated into real-time music that has cycles within 
20 cycles. The neuronal network therefore creates music without any random 
operation, and it is deterministic and controllable. 

The two dimensional oscillating pattern can be represented by dividing time into a 
series of intervals and identifying the nodes that fire in each respective interval. 

25 

NETWORK MODEL 

Referring to Fig. 1 , the artificial neuronal network is modeled as a network object 
1 0 in a computer program 2. The network object 10 comprises a plurality of 
30 integrate-and-fire node objects 20 that respectively represent each of the nodes 
of the network. 
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The connections of the network are maintained in a connection list 30 that 
comprises, for each node, pointers to the nodes that provide activation inputs and 
pointers to the nodes that provide inhibitory inputs. 

5 

The network object 1 0 defining the neuronal network is updated at each time 
interval. This involves providing excitory input impulses to the network nodes 
according to a predetermined pattern; calculating the excitation level of each 
node; determining which nodes fire; and translating the identity of the nodes that 
10 fire into a musical output. 

Determining which nodes fire when depends upon the calculation of the 
excitation level of each node, which occurs at each node object 20 at each 
interval. Each node object computes for each interval, using an activation 
15 function, its activation level for that interval. The computation takes as its inputs 
the activation neuronal impulses, which the node received in the previous interval 
from connected nodes that fired in that previous interval, the inhibitory effect of 
inhibitory connections, the excitory input impulse received (if any) and a 
vanishing (excitation) parameter. 

20 

The activation neuronal impulses, which the node received in the previous 
interval from connected nodes that fired in that previous interval (if any), increase 
the excitation level of the node. Let the energy received from activation neuronal 
impulses in the time interval n be received_neuronalJmpulse_energy(n). 

25 

The excitory input impulse received (if any) increase the excitation level of the 
node. Let the energy received from excitory input impulses at the time interval n 
be received_excitoryJmpulse_energy(n ). 

30 An inhibitory connection may reduce the excitation level of the node depending 
on the status of the node it is connected to. For example, if that node has a 
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higher activation energy it will inhibit the increase in the excitation level of the 
node. Let the energy cost of the inhibitory connections at the time interval n be 
inhibition_cost(n). 

5 The vanishing (excitation) parameter is used as a multiplying factor for the 
resultant calculated excitation level. If it is greater than 1 it increases the 
excitation level of the node and if it is less than 1 it decreases the excitation level 
of the node. Let the vanishing parameter at the time interval n be vanishing(n). 

10 The activation calculation can then be coded as: 

temp_activation level (n) = received_neuronaUmpulse_energy(n) + 
received_excitoryjmpulse_energy (n) + new_activation level (n-1) 

15 temp_activation level (n)= temp^activation level (n) - inhibition_cost(n) 

new_activation_level(n)= vanishing(n) * sigmoid(temp_ activationjevel (n)) 

20 If the resultant computed activation level ( new_activationJevet(n) ) exceeds a 
threshold value, then the node fires. 

The two dimensional oscillating pattern produced by the neuronal network is 
translated into a musical output. This is achieved by associating each node or 
25 each subset of the network nodes with a single percussive group/instrument. The 
subsets are preferably, but not necessarily, non-overlapping. A sub-set of nodes 
is typically a group of adjacent nodes. For example, if the music produced is 
drum music then each sub-set of nodes would be associated with, for example, 
one of Base drum, snare drum, hi hat, cymbal, torn drum, bong, percussion 



30 
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For each interval, the firing of the nodes in that interval are mapped in real-time 
to the sub-sets that contains those nodes. The identified sub-sets are then each 
mapped to a percussive group identity that is provided to a MIDI synthesizer. 

5 USER CONTROL 

The output of the neuronal network can be deterministically controlled via a 
graphical user interface 100 illustrated in Fig 2. 

10 The graphical user interface comprises a Setup control panel 1 1 0 that allows a 
user to program values for 'Beats', 'Seed' and 'Netsize'. 

'Netsize' specifies the number of nodes in the network. The user can, in this 
example, vary the number of node in the network between 7 and 64 by adjusting 
15 the l Netsize' slider 112. 

'Beats' specifies the number of beats to a musical bar and is used to set the 
musical signature such as 4/4 time or % time. The user can set the value of 
f Beats' by adjusting the 'Beats' slider 1 14 between 3 and 23. This value 
20 determines the layout of the node control panel 140 and in particular the number 
of buttons 141 in each row of the array 142. 

The 'Seed' slider 1 1 6 can be set by the user to determine a seed for the random 
generation of the network connections between nodes. 

25 

The button 118 initializes the network. When initialized, a schematic illustration of 
the network 2 is illustrated in a graphical display panel 120. The schematic 
display of the network 2 comprises a plurality of nodes 4.ln the illustrated 
example, there are 32 nodes corresponding to the programmed value of 
30 'Netsize'. When a node 4 fires it is highlighted by illumination 6. 
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The graphical user interface 1 00 also comprises a network control panel 1 30. 
that comprises an 'Amplitude 1 slider 131, an 'Excitation 1 slider 132, an 
'Alternation 1 slider 133 and a Tempo 1 slider 134. 

5 The 'Amplitude 1 slider 131 may be adjusted by the user to vary the musical output 
in real-time. The value of 'Amplitude' can be adjusted to be between 0 and 120. 
This parameter value increases the excitory effect of neuronal activation 
impulses and excitory impulses on all the nodes of the network. Increasing the 
value generally increases the network activity and the effect of the node control 
10 panel 140 settings on the musical output. 

The 'Excitement' slider 132 may be adjusted by the user to vary the musical 
output in real-time. The value of 'Excitement' can be adjusted between 0 and 
140. This parameter varies the vanishing (excitement) parameter that controls 
15 the preservation of energy and the self-oscillation of nodes. Increasing the value 
generally increases network activity without increasing the effect of the node 
control panel 140 settings on the musical output. 

The 'Alternation' slider 133 may be adjusted by the user to vary the musical 
20 output in real-time. The value of 'Alternation' can be adjusted between 0 and 100. 
This parameter varies the connection weight between nodes and controls the 
inhibition strength of inhibitory connections. Increasing the value generally 
increases the rigidity and repeatability of the musical output. 

25 The Tempo' slider 134 may be adjusted by the user to vary the musical output in 
real-time. The value of Tempo' can be adjusted between 0 and 70. Tempo 
controls the duration of an interval. 

A Break Switch option 135 can be selected by a user. When selected a simple 
30 break or fill-in is provided at an appropriate position such as every 2 nd , 4 th or 8 th 
bar at the second half of the respective bars, the excitation parameter is 
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enhanced momentarily by 10% and •amplitude' is increased by 5%. This creates 
more energetic drumming, the rhythm of which depends upon the overall network 
situation at the time. 

5 An Alternate Rate option 136 controls the rate at which inhibition is calculated. 
When it is not selected inhibition is calculated every interval but when it is 
selected inhibition is calculated every second interval. 

A node control panel 140 allows a user to control the pattern of the excitory input 
10 impulses and its variation in time. 

The control panel 140 comprises an energy table 142 comprising and N row by M 
column array of user selectable buttons 141 . Each row of the array corresponds 
to a different group of nodes. Each column corresponds to a portion of a musical 
15 bar and the value M is determined by the beats' parameter 114. 

Each button 141 allows a user to determine whether the excitory input impulse 
applied to a sub-set of neurons has a low value or a high value at a particular 
interval. Selecting a button 142 sets the excitory input impulse to a high value. 

20 

The influence 1 slider 146 is movable by a user during operation of the program 
and it determines the difference between a low value and a high value. 
If 'influence' is set close to 100% the musical output would be almost dictated by 
the energy table 142 configuration, whereas if influence is close to 0% the 
25 generated musical output would be based on the CPG network internal dynamics 
only. 

The sliders 150 allow a user to adjust the sensitivity of different neuron groups to 
both excitory inputs and neuronal inputs. There is a different slide associated with 
30 each row. In practice, this allows a user to make certain groups of neurons more 
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sensitive to the pattern of excitory impulses programmed in the respective row of 
the energy table 142. 

The pattern of which nodes are excited when is determined by selecting different 
5 ones of the buttons 141 . The slider 146 determine the difference in effect 
between selecting and not selecting a button. The sensitivity of the different 
node groups to inputs is set by adjusting the sliders 150. 

At set-up the user defines the set-up parameters using the set-up control panel 
10 110. The program then randomly creates connections between the nodes. 

Nodes are interconnected in such a way that each neuron's activity level inhibits 
growth of some other neuron's activity level. 

The program initializes the other parameters in the network control panel 130 and 
15 the neuron control panel 140 at default values, which the user can modify while 
the program is running. The network object is then updated at each interval and a 
music output is created in real-time at each interval. 

The user can therefore increase the activity of the music by increasing 
20 'Amplitude 1 131 and/or 'Excitement' 140, the user can vary the stability of the 

music by changing 'Alternation' 133 and the user can vary the tempo of the music 
by varying 'Tempo' 134. 

The user can also vary the pattern of excitory impulses provided to each group of 
25 nodes using the buttons 141 and slider 146 and their sensitivity to such input by 
adjusting the sliders 150. Once a desired musical style is achieved, it can be 
stored and recalled later if desired. 



30 The neuron control panel 140 can be used to program a style of music. For 
example (simplified rock) would be: 
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Hihat xoxoxoxo 
Bass xoooxooo 
Snare ooxoooxo 

5 It would be a simply modification to the illustrated graphical user interface to 
include a drop-down menu for selecting different musical styles. The selection of 
a particular style would automatically program the energy table 142 of the neuron 
control panel 140 with the appropriate configuration i.e. which of the buttons 141 
are depressed. 

10 

Although embodiments of the present invention have been described in the 
preceding paragraphs with reference to various examples, it should be 
appreciated that modifications to the examples given can be made without 
departing from the scope of the invention as claimed. For example, although in 

15 the described embodiment the tempo is set according to a slider 134, in 

alternative embodiments the tempo may be set by tapping a key or by shaking a 
device or from some other input. For example a heart rate sensor may provide 
the tempo or the most prominent (bass-drum) drum beat is synchronized with the 
heart pulse. The heart pulse rate may alternatively be used to control the interval 

20 between excitory impulses. As the heart rate increases, the interval decreases 
and as the heart rate decreases, the interval increases. Consequently, music can 
be generated during physical activity that changes with the activity level of the 
user. The changes to the music as the activity level changes are not just in the 
music tempo, but in the pattern of the music that is generated. The history of the 

25 heart rate may also be used as an input parameter and pattern of music 
generated may depend upon the user identify a type of sport. 

The above described methodology may be used to compose a ring-tone for a 
mobile telephone. 

30 
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Whilst endeavoring in the foregoing specification to draw attention to those 
features of the invention believed to be of particular importance it should be 
understood that the Applicant claims protection in respect of any patentable 
feature or combination of features hereinbefore referred to and/or shown in the 
5 drawings whether or not particular emphasis has been placed thereon. 
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